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Abstract 


This  paper  deals  with  the  problem  of  deriving  two-stage  allocation  procedures  for  selecting  the 
best  normal  population.  If  the  prior  distribution  is  assumed  to  be  known,  an  exact  Bayes  two-stage 
allocation  procedure  is  obtainedj^lf  the  prior  distribution  depends  on  some  unknown  parameter, 
an  adaptive  two-stage  allocation  procedure  is  proposed.  Using  the  empirical  Bayes  formulation,  we 
prove  that  the  proposed  adaptive  two-stage  allocation  procedure  has  some  asymptotic  optimality 
property.  __ 
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1.  Introduction 

Consider  the  following  problem.  Suppose  that  an  experimenter  (a  customer)  wishes  to  purchase 
M  items  of  some  product.  We  assume  that  these  items  are  supplied  by  k  different  manufacturers 
(suppliers),  say,  iri,...,7r*.  At  first,  the  experimenter  carries  out  an  inspection  on  each  of  the 
k  suppliers’  product  by  using  m  items  of  the  product  to  obtain  data  for  determining  the  quality 
of  each.  Then,  based  on  the  resulting  data,  he  allocates  the  remaining  M  —  km  items  to  the  k 
suppliers,  say,  Ni,...,  Nk,  respectively,  where  ATj,  i  =  I,.  ..,k,  are  nonnegative  integers  such  that 

k 

TVj  =  Af  —  km.  Let  $i  denote  a  measure  of  the  quality  of  the  product  from  the  ith  manufacturer 

•=i 

Tj.  Let  ^[1]  <  . . .  <  tf(fc]  be  the  ordered  values  of  the  parameters  9i,...,$k.  It  is  assumed  that  the 
exact  pairing  between  the  ordered  and  the  unordered  parameters  is  unknown.  The  supplier  Xi  with 
—  ^[fc]  is  called  the  best.  Of  course,  the  experimenter  would  ideally  like  to  allocate  (purchase) 
the  remaining  M  ~  km  items  from  the  “best”  supplier.  Thus,  the  experimenter  is  faced  with  the 
so-called  two-stage  allocation  and  selection  problem. 


For  the  two-stage  allocation  problem  described  above,  we  define  the  corresponding  loss  function 


to  be; 


Lie-,  m,  IVi, .  ..Nk)  =  m  '^[e^k]  -  <>0  +  E 


where  0  =  (^i,...,^*),  0  <  m  <  [^],  0  <  iVj  <  Af  -  km,  %  =  \,...,k,  ^  N,  =  M  -  km,  and  [y] 

•=i 

denotes  the  largest  integer  not  greater  than  y.  Note  that  the  first  summation  in  (1.1)  is  the  loss  due 
to  the  choice  of  the  common  initial  number  of  items  to  be  supplied  by  each  of  the  k  manufacturers, 
and  the  second  summation  in  (1.1)  is  the  loss  due  to  the  allocation  made  at  the  second  stage.  Our 
goal  here  is  to  derive  optimal  two-stage  allocation  procedures  with  respect  to  the  loss  function  (1.1). 
We  study  the  problem  for  normal  populations,  say  Xi, . . . , itk,  with  unknown  means  01,. .  .,0k,  and 
a  common  known  variance  The  unknown  means  0i,...,9k  are  assumed  to  be  independent  and 
identically  distributed  with  a  normal  prior  distribution  N{0o,  t*),  where  the  value  of  the  parameter 


may  be  either  known  or  unknown. 


We  note  that  Sonaerville  (1970, 1974)  studied  a  two-stage  minimax  allocation  procedure  for  the 
normal  distribution  model  with  a  different  loss  function.  However,  since  the  loss  function  considered 
by  Somerville  (1970)  is  not  bounded,  the  minlmax  solution  does  not  exist  (see  Ofosu  (1974)  for 
a  comment).  Ofosu  (1975)  also  studied  a  two-stage  allocation  procedure  via  a  Bayesian  approach 
(see  Gupta  and  Panchapakesan  (1979)). 

2.  Normal  Model 

We  study  the  allocation  problem  in  terms  of  normal  populations,  say  Xj , . . . ,  tt*,  with  unknown 
means  , . . . ,  0*,  and  a  common  known  variance  .  The  unknown  means  , . . . ,  0*  are  assumed 
to  be  independently  and  identically  distributed  with  a  normal  prior  distribution  iV(^O)  ''■*)•  In  this 
section,  we  assume  that  the  value  of  the  parameter  is  known.  Also,  for  simplicity,  we  assume 
that  M  =  kN  for  some  positive  integer  N . 


2.1.  Bayes  Allocation  Procedure  for  a  Fixed  m. 

First,  we  take  m,  0  <  m  <  N ,  random  observations  from  each  of  the  k  populations.  Let  .V, 

denote  the  sample  mean  of  the  m  random  observations  taken  from  population  tt,  and  let  x,  denote 

the  associated  observed  value,  i  =  l,...,fc.  At  the  second  stage,  based  on  the  observed  values 

X  =  (ii, ..  .,!*),  allocate  Ni{x)  random  observations  from  population  tt,,  t  =  1,...,!:,  where 

*  _ 

iVi(r), . . .,  iVfc(r)  are  nonnegative  integers  such  that  Ai(x)  =  k{N  -  m).  Let  F,  denote  the 

i=l 

sample  mean  of  the  iV,(x)  random  observations  taken  from  the  population  n,  at  the  second  stage, 
and  let  j/j  be  the  associated  observed  value,  »  =  l,...,k.  Also,  let  y  =  (Vi ,•••  ,!/*)•  Note  that 
when  either  m  =  0  or  m  =  N ,  the  above  allocation  procedure  is  reduced  to  a  one-stage  allocation 


procedure. 

At  stage  two,  given  A  =  ?  and  F  =  J,  respectively,  the  posterior  expected  loss  is; 
r mix, ^)  =  E[L{e-,m,  Niix),.  ..,Nk(x))\X  =  x,  F  =  ^] 

=  kNE[0^k]\X  =  f,  F  =  f]  -  J3(m  -I-  Nj(x))E[9j\X  =  f ,  F  =  ^]. 

j=i 


(2.1) 


2 


.  -Atk  1'  -  4'  • 


»>**».*  a*.  ****iV'i<*  i**  r»  i>  i 

h**.' 


liVl 


Therefore,  at  stage  one,  given  X  =  x,  the  posterior  expected  loss  is  given  by 
r„.(x)  =  E[rr^(X,V)IX  =  f] 

k 

=  kNE[0^,]\X  =  ?]  -  5](m  +  NjmE[0:\X  =  f] 


i»rr.r/.  -1  .  XT  +  mr'^Xj  (2.2) 

=  kNE[0ik]\X  =  x]-  ^(m  +  iVjCj))--; 
i=i 

i.A7rr/i  IV-  -1  ^  XT  +  rnT^Xj 

=  *«£[«, »||X  =  x]  -  m  5:  -  E  '■ 

J=1  J=1 

For  each  observed  X  =  x,  let  A('x)  =  {i|x,  =  Then,  for  a  fixed  m,  the  Bayes 

allocation  at  the  second  stage  is  to  choose  the  nonnegative  integers  Ni^x),. .  .Nk(x)  such  that 

53  Ni{x)  =  k{N  —  m).  Then,  conditional  on  m  and  the  observed  value  X  =  T,  the  minimum 
«e.4(x) 

posterior  expected  loss  is: 

rS(r)  =  tArE[«|»||T  =  ?|  -  ?2£i±^^ 

k{N  -  +  rnr^  max  X;] 


<7*  +  mr* 


and  the  minimum  Bayes  risk  for  a  fixed  m  is: 


r«  =  F;[r»(X)] 


,»rr.rx.  ,  j^0o<r'^  ■¥rnT'^E[Xj] 

i=i 

fc(A^  -  m){0o(T^  +  mT^£’[^max^  Xj)} 

<7*  +  mr* 

Note  that  under  the  statistical  model,  Xi,. .  .iXk  are  iid  and  have  a  marginal  normal  dis¬ 
tribution  with  mean  and  variance  ^  -i-  r^.  Thus,  E[  max  Xi]  =  +  \/ ^  +  max  Z,]  = 

m  l<t<*  V  ”»  1<J<* 

00  +  o,  where  Z\,.  ..,Zk  are  iid  N(0, 1)  and  a  =  ^^[^max^  Zj].  Also,  £[0(fc|]  =  +  to. 


Hence,  we  have 


x»  =  .x»(^  - 

\/<7^  -I-  mr^ 


ii!*; 


'•*1 


Note  that  the  minimum  Bayes  risk  r®  does  not  depend  on  the  parameter  6q. 


2.2.  Optimid  Initial  Sample  Size. 

Next,  we  want  to  find  an  integer,  say  m^,  0  <  ms  <  N  such  that  <  r®  for  all  integers  m 
in  [0,iyr].  We  call  such  an  integer  ms  as  an  optimal  initial  sample  size.  When  mg  is  determined, 
a  Bayes  two-stage  allocation  procedure,  say  Pg,  is  given  as  follows: 

First,  take  mg  random  observations  from  each  of  the  k  populations.  Compute  the  observed 
sample  mean  Xi,  i  =  l,...,k.  Then,  take  k{N  -  mg)  random  observations  from  the  population 
which  yields  the  largest  sample  mean  value. 

Note  that  finding  an  integer  m  in  [0,  iV]  to  minimize  the  Bayes  risk  r®  is  equivalent  to  finding 
an  integer  m  in  [0,  iV]  to  maximize  {N  -  m)y/mfy/<T'^  +  mr^  [see  (2.5)].  In  general,  we  assume  m 
to  be  a  variable  and  for  each  fixed  r*  >  0,  let 


n  r.M’i 


(2.6) 


<T*  -f  mr’ 

be  a  function  defined  on  the  interval  [0,  N].  Then,  the  first  derivative  of  the  function  Hr^{m)  with 
respect  to  m  is 

rr,  ,  ^  (m-iV)[(3m-N')(T*-|-2m*7-2] 

’ 

which  is  nonpositive  if  ^  <  m  <  iV.  That  is,  the  function  Hr^{m)  is  nonincreasing  in  m  for  m 
in  the  interval  [^,  ^j.  Thus,  to  find  a  number  m  in  the  interval  [0,  iV]  to  maximize  the  function 
Hriim),  it  suffices  to  consider  those  m  in  the  subinterval  [0,  ^].  Let 


N, 


Gim)  =  (m  -  iV)[(3m  -  N)<t^  +  2mV^],  m  £  [0,  — j. 


Then, 

N 

G'{m)  =  (3m  -  27V)(2<r*  -f-  2mr*)  <  0,  for  all  m  6  [0,  y). 

In  other  words,  G(m)  is  a  decreasing  function  of  m  for  m  6  [0,  yj.  Also,  note  that  (7(0)  > 
0,  G{^)  <  0.  Thus,  there  exists  a  unique  number  in  (0,  ^),  say  m*,  such  that  G(m*)  =  0.  Hence. 


>  0  for  all  m  €  [0,  m*);  H!^3{m)  <  0  for  all  m  G  (m*,  ^),  and  =  0.  This  implies 

that  the  function  achieves  its  maximum  at  m  =  m*.  Note  that  m*  is  the  positive  solution 

of  the  equation  (3m  -  N)(t^  +  2m*r*  =  0.  That  is, 


m*  =  (— 3<t^  +  v8iVr*^*  +  9^)/(4r^) 


ms  = 


=  2JV<7/[\/8iVT^  +  9a*  +  3<t]. 


[m*]  if^Ta([”»’])  > 

[m*]  +  1  if  ^T2([m*])  < 


]  +  1)> 

]  +  l)- 


Therefore,  the  minimum  Bayes  risk,  denoted  by  r®,  of  the  Bayes  two-stage  allocation  procedure  is: 

=  (2.9) 

-1- 

Remarks  2.1 


a)  For  fixed  N  and  <t^,  the  optimal  initial  sample  size  ms  can  be  viewed  as  a  function  of  the 
parameter  r^,  and  hence  is  denoted  by  mfl(r*).  From  (2.6),  (2.7),  (2.8),  one  can  see  that 


1  <  mB(r*)  <  [-— ]  -H  1  for  any  r*  >  0. 

t5 


Furthermore,  we  have  the  following  results: 


lim  TTiBir)  =  1  and 

T^— »00 


,2,  /[fl  ifiV  =  0orl 


or  1  (mod  3), 
(mod  3). 


b)  From  (2.7),  m*  is  a  decreasing  function  of  the  parameter  r^.  Thus,  from  (2.8),  one  may  expect 


that  mB(r*)  is  nonincreasing  in  r*.  Actuadly,  we  have  the  following  results: 


j  If  Tj*  >  r|,  then  mB{T^)  <  mB(r|). 
\  If  TTiBiT^)  <  mBir^),  then  >  r|. 


(2.10) 


which  can  be  obtained  directly  from  the  following  lemma. 


fpy^qwmf,yti  I^WWIWWW  WW  W  W.  /W/WJ  ^ff/lfV  yv  >*V  Tntjnt  .w  Uff  nffVJlUT 


Lemma  2.1.  Let  Hr^(m)  =  1  <  w»  <  [^]  + 1  and  r*  >  0.  If  H^tijn)  > 

then  Hrfim)  >  H^i(m  +  1)  for  all  r*  >  Tj  . 

Proof:  By  the  given  condition, 

0  <  -  H^i{m  +  1) 

_  {N  -  m)^m[<r^  +  (m  +  l)r^]  -  +  mT^){N  -  m  -  l)^(m  +  1) 

(<t2  +  mr|)[o'2  +  (m  +  l)r|] 

Let 

h(r*)  =  (N  -  m)*m[<T*  +  (m  +  l)r*]  -  (<t^  +  mr'^){N  -  m  -  l)^(m  +  1). 

Hence,  h{Tj)  >  0.  Also,  the  first  derivative  of  h{T^)  with  respect  to  is 

h'(r*)  =  — =  Tn(m  +  l)[2(iV  -  m)  -  1]  >  0  for  all  1  <  m  <  [^]  +  1, 
dr^  o 

which  implies  /»(r*)  is  an  increasing  function  of  r*.  Thus,  h{T^)  >  h{T^)  >  0  since  >  r|. 
Therefore,  we  have  /f,.a(m)  >  J7,.a(m  +  1). 

3.  An  Adaptive  Two-Stage  Allocation  Procedure 

In  this  section,  we  still  assume  the  normal  model  except  that  the  value  of  the  parameter  r*  is 
unknown.  Thus,  the  Bayes  two-stage  allocation  procedure  derived  in  Section  2  can  not  be  applied 
in  this  situation.  To  overcome  this  difficulty,  we  propose  an  adaptive  two-stage  allocation  procedure 
via  the  empirical  Bayes  approach. 

We  now  consider  the  following  situation.  Suppose  that  one  is  confronted  repeatedly  and 
independently  with  a  sequence  of  the  allocation  problems  as  described  in  Section  1.  We  can  then 
use  the  past  observations  at  hand  to  construct  an  estimator  for  the  unknown  parameter  r*.  This 
estimator  is  then  applied  to  form  an  adaptive  two-stage  allocation  procedure  for  the  next  allocation 
problem.  Suppose  now,  we  are  at  time  f  =  n  -H  1.  We  have  already  had  n  past  observations  at 
hand.  We  let  nij  denote  the  adaptive  optimal  initial  sample  size  taken  at  stage  one  at  time 

t  =  j,  j  =  l,...,n.  The  determination  of  mj  will  be  described  later.  From  Remark  2.1  a), 

i 


6 


•Jt*  »«***><  4*tf»a  **■*<*>  i*k'it«'il«  AP.'.’4^‘AtW*'a%a*At.*alk*At><'Ati.*4l>*AlL''AV.*a^*At  ''kMJI 


1  <  mj  <  (^]  +  1.  That  is,  we  take  at  least  one  observation  from  each  of  the  k  populations  at 
each  time  j  =  l,...,n.  We  let  Xij  denote  the  one  observation  taken  from  population  at  time 
j,  j  =  1, . . . ,  n.  Then,  under  the  normal  model,  Xij  has  a  marginal  normal  distribution  with  mean 
Oq  and  variance  a*  +  r*.  Also,  following  the  usual  empirical  Bayes  formulation  (for  example,  see 
Robbins  (1983)  or  Gupta  and  Liang  (1987)),  we  can  assume  that  Xij,  j  =  1, . . . ,  n;  i  =  1, . . . ,  A:, 
are  independently  distributed.  In  the  following,  we  only  consider  the  case  when  the  value  of  the 
parameter  Bq  is  unknown.  Thus,  let 

^(n)  =  E  E  Xij, 

_  (3.1) 

SHn)=T^T,  EiXij-X{n))K 

i=i j=i 

Then,  (kn  —  l)S^(n)/(<T^  +  r^)  has  a  -distribution  with  degrees  of  freedom  kn  —  1.  Since  is 


positive,  we  suggest  using 


rUi={SHn)-ay 


to  estimate  the  unknown  parameter  r^,  where  y'*'  =  max(0,  y).  When  >  0,  we  define  m„+i, 
the  adaptive  optimal  initial  sample  size  at  time  t  =  n  +  1,  to  be  an  integer  in  the  interval  [0,Af] 


which  maximizes  the  function  ”*  among  all  the  integers  in  the  interval  [0,  jV]. 

From  Remark  2.1  a),  1  <  m„+i  <  [^]  +  1.  When  =  0,  we  let  m„+i  =  [y]  (or  [y]  +  1)  if 
([^])  >  (<)^t’^,([^]-I‘  1).  Note  that  when  n  =  0,  i.e.  there  is  no  paist  observation  available, 
we  choose  any  integer  mi  in  the  interval  [1,  [y]  +  1]  as  the  initial  sample  size. 

We  then  propose  an  adaptive  two-stage  allocation  procedure,  say  Pn+i ,  at  t  =  n  -h  1  as  follows: 

At  time  t  =  n  1,  first  take  m„+i  observations  from  each  of  the  k  populations.  Compute  the 
observed  sample  mean  i,  based  on  the  m„+i  observations  taken  from  population  Xj.  Then,  take 
k{N  —  m„+i)  random  observations  from  the  population  which  yields  the  largest  sample  mean  value. 

We  denote  the  conditional  Bayes  risk  given  m„+i  and  the  Bayes  risk  of  the  adaptive  two-stage 
allocation  procedure  Pn+i  by  r„+i(m„+i)  and  r„+i,  respectively.  That  is, 

V  [^n+ 1  (^n+l  ))» 


i 


I 


S' 

& 

'k 


rwwww  wv  mi  ir j»vin;vvinri*UTruwvu»^^  »vyvTrjirj  ify  ;■ 


where  the  expectation  E  is  taken  with  respecpt  to  mn+i  or  the  probability  space  generated  by 

Note  that  rn+i(Tn„+i)  -  r®  >  0  since  is  the  minimum  Bayes  risk,  and  therefore  r„+i  - 
r®  >  0.  The  two  differences  r„+i(m„4.i)  —  r®  and  r„+i  —  r®  are  always  used  as  measures  of  the 
performance  of  the  proposed  two-stage  allocation  procedure  P„+i. 

Definition  3.1 

a)  The  sequence  of  adaptive  two-stage  allocation  procedures  {Pn+i}  is  said  to  be  asymptotically 
optimal  in  probability  of  order  {on}  if  for  any  £  >  0,  P{r„+i(m„+i)  -  r®  >  £}  <  0(q'„)  as 
n  —*  oo  where  {on}  is  a  sequence  of  positive  numbers  such  that  lim  On  =  0- 

b)  The  sequence  of  adaptive  two-stage  allocation  procedures  {P„+i}  is  said  to  be  asymptotically 
optimal  of  order  {/3n}  if  ^n+i  —  r®  <  0(/J„)  as  n  — ^  c»  where  {^n)  is  a  sequence  of  positive 
numbers  such  that  lim  =  0. 

n— >00 

In  the  following,  we  will  investigate  some  asymptotically  optimal  properties  of  the  proposed 
adaptive  two-stage  allocation  procedures  {P„+i}. 

Let  I  =  {m(m  is  an  integer  in  [1,  [^]  4-  1]  such  that  ^  0},  and  let  c  = 

min{PT3(”iB)  -  HT2{Tn)\m  £  /}.  Then,  by  the  definitions  of  ttib  and  the  set  /,  c  >  0. 


Lemma  3.1. 


a)  Suppose  that  m„+i  €  /  and  m„+i  <  mg.  Then 


c  <  -  E r^{mn+i)  <  d 


where  d  *  =  N*/{16(7*). 

b)  Suppose  that  m„+i  €  I  and  Tn„+i  >  mg.  Then, 


c  <  ^t^C^b)  -  Hr3{mn+\)  <  d  *(t*  - 


tS'l**'  I*.*!*. 


Proof: 

a)  By  Lemma  2.1,  as  m„+i  6  I  and  rriB  >  »n„+i,  we  have  Thus,  on  the  event  that 

m„+i  e  I  and  <  r^+i,  we  have 

c  <  Hr^iims)  -  H^iimn+i) 

{N  -  mBfrriB  (JV  -  mn+\fmn+x 


(7^  + 


cr2  +  m„+ir2 


AN-TTiBfmB  {N  -ruBfruB,  . 

^2  ^  fj2  tUbtI^x 

AN  -  THB^mB  _  (N  -  mn+i)^m„+i 

<t2  +  mBT^+i  +  "i„+,r2^i 

(jV  -  mn+i)^mn+i  _  {N  -  mn+i)^mn+i. 

a2  +  TO„+ir2^j  o2  +  m„+ir2 

In  (3.4),  ’?"ti  <  0  which  is  obtained  by  the  definition  of  m^+i,  and 

<  0  by  noting  that  <  r^. Thus,  we  obtain 

a^  +  m.  +  iT'^,  a^+m.  +  iT^  ^  o  n+i  » 


C  <  HrlimB)  -  Hrii^nn+l) 

<  -  rnB^mB  _  (iV  -  mB^rriB 

~  <t2  4-  mar^  0-2  +  maT’^+i 

-mB)^myr2^i  -r^) 

(<72  +  mBr2)(<72  +  mar^+i ) 

which  completes  the  proof  of  part  a). 

b)  By  Lemma  2.1  again,  as  rrin+i  6  /  and  ma  <  ”^n+i,  we  have  Thus,  under  the 

event  that  m„+j  G  /  and  >  7-2^,,  we  have 

c  <  Hr^{mB)  -  Hri{mn+t) 

_  (A'^  -  mBfruB  _  (iV  -  mn+i)2mn+i 
a'^  +  rriBr'^  +  rUn+iT'^ 

AN-rriByrnB  {N  -  mB)'^rnB  ^  ^  f(^  -  ma)^ma  {N  -  mn+ifm^+i . 
cr'^  +  mBT'^  (72  +  mBr^+i  c^^  +  fneTn+i  + '^n+l^^+l 

.(AT  -  mn+i)2mn+l  _  (A^  -  mn+i)2mn+l  , 

^  (72  +  m„+ir2^i  (72  +  m„+ir2 


kfl  ' 
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5< 


VVS^I 


<  -  ^n+l)^mn+l  _  {N  -  mn+i)^mn+i 

(72  +  mn+ir^+,  <7*  +  m„+ir2 

^  -  mn+i)^ml+i(T'^  -  r^+i) 

((72  +  m„+ir*^.,)(«72  +  m„+ir2) 


<  d-\T^ 


(3.7) 


Lemma  3.2. 

a)  P{r„+i(m„+i)  >  rg)  <  P{lr^+i  -  r^l  >  dc}. 

b)  r„+i  -  rs  <  kar'^lHriimB)]^ P{\t1^i  ~t^\>  dc}. 


Proof: 

a) 

^{^n+i(m„+i)  >  re} 

=  P{Hr^{mB)  -  Hr2{mn+i)  >  0,  mn+i  e  1} 

-  P{HrAmB)  -  H.,:,{mn+i)  >  c,  m„+i  6  /} 

(by  the  definition  of  the  set  I) 

=  P{Hr2{mB)  -  /fT3(mn+i)  >  c,  m„+i  e  I,  tub  <  m„+i} 

+  P{Pt2(ttib)  -  Hr2{m„+\)  >  c,  m„+i  G  /,  ms  >  m„+i} 
<  P{t^  -  >  dc}  +  P{t*+i  -  >  dc} 

(by  Lemma  3.1) 

=  P{\-rl+i  -r^\  >  dc). 
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=  £;[r„+i(m„+i)-  ra] 

=  E[kaT\HAmB))^  -  (/rr^(m„+,))i]] 

<  kaT^[Hr-i{mB)\^ P{HT-i{mB)  -  >  0} 

=  kaT^[Hr^{mB)\^P{Br-i{mB)  -  Hr^inin+i)  >  c} 

<  kaT\HMmB)]^P{\rl+i  -  r^j  >  dc) 

where  the  last  equality  is  obtained  from  the  definition  of  the  constant  c,  and  the  last  inequality 
is  obtained  from  the  proof  of  part  a)  of  this  lemma. 

From  Lemma  3.2,  in  order  to  investigate  the  asymptotic  behavior  of  P{r„+j(m„+i )  >  ra}  and 
r„^.i  -  ra,  it  suffices  to  study  the  asymptotic  behavior  of  the  probability  P{|r^+i  -  >  dc). 


From  Lemmas  3.2  and  3.3,  we  conclude  the  following  theorem. 

Theorem  3.1.  The  seoupnce  of  adaptive  two-stage  allocation  procedures  {P„+i}  is  asymp¬ 
totically  optimal  in  probability  of  order  and  asymptotically  optimal  of  order  {n“*}.  That 


F{r„+i(m„+i)  -  r®  >  £}  <  0{— )  as  n  oo  for  any  £  >  0, 


r„+i  -  r®  <  0(— )  as  n  — >  oo. 
n 
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